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1. INTRODUCTION 

This Quarterly Technical Report No. 9 describes several 
aspects of our technical progress on the ARPA computer network 
during the first quarter of 1971. During this quarter, we 
installed IMP No. 12 at the University of Illinois and IMP No. 15 
at Burroughs Corporation in Paoli, Pennsylvania. We also re¬ 
ceived delivery from Honeywell of a prototype 316 IMP, a prototype 
Terminal IMP, and the first deliverable Terminal IMP (both to be 
fitted with Multi-Line Controllers during the next quarter). The 
316. IMP was debugged and connected in the BBN test cell to the 
ARPA Network, and is operating in the normal fashion. [The IMPs 
actually delivered to Carnegie-Mellon University and to Case- 
Western Reserve University during the last quarter of 1970 were 
numbered 14 and 13 s respectively, instead of 13 and 14 as pre¬ 
viously reported.] 

The telephone company installed six additional circuits 
during this quarter, connecting Utah/Illinois, Illinois/MIT, 
Lincoln/Case, Case/Carnegie, Carnegie/Paoli, and Paoli/Harvard. 

The temporary MIT/Utah circuit, which was installed in June 1970 3 
has been discontinued. The total number of wideband circuits in 
the net is now 19. 

The logic design of the Multi-Line Controller (MLC) was 
completed during this quarter and we commenced implementation 
of a prototype MLC unit. The design of the Terminal IMP program 
was advanced almost to completion and efforts on coding of the 
Terminal IMP program were intensified. In addition to handling 
characters from terminals, this program will initially incorporate 
those aspects of Host protocol required for flow control, handling 
connections, logging, and teletypes. This work is described in 
Section 2. 
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A study of the relationship between buffer allocation, the 
routing algorithm. Host protocol, and subnet performance was 
completed during this quarter. During this study, several new 
algorithms were developed to improve system performance. These 
algorithms are described in Section 3- 
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2. TERMINAL IMP 

2.1 Multi-Line Controller 

During the last quarter, we completed the logic design of 
the .Multi-Line Controller (MLC) and fabricated a prototype of 
the common logic and the Line Interface Unit (LIU). The MLC 
control panel and additional LIUs will be completed early in the 
next quarter, at which point debugging will begin. 

The MLC is divided into an input section and an output 
section to handle traffic flow in both directions between 
terminal devices and the Honeywell 316- The input section of 
the MLC accepts characters bit serially from each of up to 64 
terminal lines and assembles and delivers each whole character, 
along with a line number indication, into the 316's memory via 
a single DMC channel. The MLC accepts 5-, 6-, 7-, or 8-bit 
characters having one start and either one or two stop bits. 

The start and stop bits are stripped off each character by the 
MLC and the assembled characters are presented right justified in 
an 8-bit field of the DMC word. 

Characters are delivered up to 64 terminal lines via a 
second DMC channel and the output section of the MLC. The MLC 
transmits 5-, 6-, 7-> or 8-bit characters, as delivered by the 
program, with either one or two stop bits. The start bit is 
automatically inserted by the MLC and need not be specified by 
the program. 

The MLC contains a 74-bit by 64-word memory and each of the 
64 terminal lines is assigned one of the memory locations, which 
is called the STATEWORD for that line. The STATEWORD records 
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the instantaneous state of data transmission and control status 
on a line. A 56 -bit portion of the memory, illustrated schematically 
in Figure 1, is realized as a serial, pseudo-drum memory built from 
circulating shift registers. The remaining 18 bits of each STATE- 
WORD are stored on a per-line basis on an individual Line Interface 
Unit (LIU). The pseudo-drum rotates once per 51.2 ysec, permitting 
a complete revolution per bit at 19.2 kilobits/sec. As each 
STATEWORD is presented to the MLC common logic, the next process¬ 
ing step for that particular line is performed, e.g., a partially 
assembled character is shifted one bit and a new input bit is 
inserted. Up to 64 lines are serviced in sequence by the common 
logic processing the STATEWORDs. 

In the STATEWORD for each line, the Terminal IMP program 
must set the input rate and character size. In addition, it may 
set a bit to indicate a high-speed input line that is to be 
given priority access to the DMC channel. A character from a 
terminal is shifted, one bit at a time, into the input data 
section of its STATEWORD, until a complete character is assembled. 

The complete character is then moved to the input data buffer 
section of the input STATEWORD to await service by the DMC 
channel, thus allowing the assembly of the next input character 
to begin. 

For output to a terminal, each character is loaded from the 
DMC into the output data section of its STATEWORD, for double 
buffering, while the previous character is shifted out. When 
the previous character has been shifted out, the contents of 
the output data section are moved from the double buffer. The 
bits are then shifted out at the rate required by the line being 
serviced, and a request for the next character is sent via the 
DMC to the Terminal IMP program. 
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A portion of the control circuitry for each line is con¬ 
tained in the Line Interface Unit. The LIU handles signals which 
cannot be time multiplexed by the pseudo-drum. Such signals are 
the output data line and modem control lines. A prototype of 
the LIU has been fabricated on a printed circuit card using 30 
ICs . 


2.2 Terminal IMP Software 

The Terminal IMP program will be composed of the regular 
IMP program plus additional code and buffering to handle up to 
64 terminal devices. The design of the terminal-handling portion 
of the software is at an advanced stage of progress and several 
major parts have already been coded. This portion of the program 
will communicate with the regular IMP program via a software 
Host/IMP interface. Thus, all devices at a Terminal IMP will be 
addressable as belonging to a single Host. 

Five principal functions of the software are: 

1) Terminal input — buffering characters from the 
terminal into appropriate format and shipping 
them to the net; 

2) Terminal output — accepting messages from the net, 
unpacking and reformatting to a form suitable for 
the terminal, and delivering'characters to the 
terminal as requested by the Multi-Line Controller; 

3) Protocol — communicating with Hosts, IMPs, NCPs, 
and loggers in the language they understand; 
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4) Command Language — conducting a dialog with a 
user via his terminal to provide him with the 
capability to effect mode settings and otherwise 
set Terminal IMP parameters; 

5) All else — initialization monitoring modem 
status, etc. 

An initial effort has been made to define a command language 
for the Terminal IMP. At this point, the command language is 
still under development and we are specifying both the parameters 
and options the user will have and how he communicates them to 
the Terminal IMP. It is clear that the Terminal IMP cannot 
support a very elaborate command language, and that it must be 
able to do both the job called "Telnet" (in the Host protocol 
jargon) and a subset of the file transfer protocol. The Telnet 
protocol is currently under development by a committee of Host 
protocol representatives and the file transfer protocol will be 
developed at a later date. 

One useful measure of the Terminal IMP performance is the 
total supportable terminal bandwidth. This measure is obtained 
from a complex function of hardware organization, network per¬ 
formance, available buffer space, amount of usable phone line 
bandwidth, and several Host and Terminal IMP program running times. 
A key parameter is the per character processing time that sets 
an upper bound on bandwidth. Our current best estimate is that 
this upper bound is about 150 kilobits/sec for the most critical 
case of 19.2 bits/sec terminals and that we will be able to 
achieve our goal of 100 kilobits/sec. 


7 



Report No. 2123 


Bolt Beranek and Newman Inc. 


3. THROUGHPUT AND PROTOCOL STUDY 

During this quarter, we completed a study on the design and 
performance of the ARPA Network. Two important objectives of this 
study were tc seek improved algorithms that provide efficient 
performance under heavy traffic load and to obtain an increased 
understanding of the relation between the number of packet buffers, 
the system design 3 and system performance. Several improved 
algorithms were developed for handling heavy traffic and are 
described below. A separate report on the results of this 
study is in preparation. 

To improve congestion control, we have designed a scheme to 
alleviate congestion at a destination IMP by reserving reassembly 
space for each message before allowing it to enter the net and 
by delaying the return of RFNMs from the destination when re¬ 
assembly space is unavailable. This scheme prevents the inser¬ 
tion of more traffic into the net than the destination can 
handle. 

We have also developed a routing algorithm to achieve high 
throughput under heavy traffic load and we are currently studying 
its performance properties. The algorithm combines the use of 
periodic as well as aperiodic updating of routing tables. The 
periodic routing update occurs every half second to provide 
a reliable and efficient means of maintaining routing information 
when network conditions are not changing markedly. The aperiodic 
updating results from important status changes such as the 
failure of an IMP or circuit, or a circuit becoming fully 
occupied. 
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Each IMP is allowed to route traffic to a given destination 
on one or more lines to the destination. If two or more paths 
share a common circuit, normally only one of the paths will be 
selected. However, if extra capacity is needed and more than 
one path is required to obtain it, the IMP allows additional 
paths to be set up. In this scheme, the selection of routes does 
not use information about the instantaneous movement of packets 
in the network. (The routing information cannot be propagated 
about the net'in sufficient time to reflect accurately this 
instantaneous traffic flow and it is, therefore, decoupled from 
these events.) Instead, average traffic flow is used in the 
selection of routes and additional routes__ are established, if 
possible, only when the capacity is reached on the established 
paths. 3y using an averaging procedure in the measurement, the 
flow of traffic must build up smoothly. This allows the routing 
algorithm ample time to adjust its tables in each IMP in advance 
of the buildup of traffic. 

This routing algorithm contains a metering procedure that 
limits and adjusts the maximum flow of traffic on each circuit. 

The flow is changed in such a way as to allow the overall network kk 
flow to be increased, but to change only slowly for stability. 

Several other algorithms were developed during the course 
of this study. These are: 

1) An algorithm to provide an "overflow network" in which 

a small amount of traffic is guaranteed to be delivered 
to the destination if a path exists. This algorithm 
guarantees a small throughput at the cost of two 
buffers per IMP and a few percent of line capacity; 
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2) An algorithm to modify the acknowledgment procedure 

in a way that substantially saves processing time and 
makes more efficient use of the phone lines; 

3) An algorithm to allocate buffers efficiently for use 

in store and forward and for sharing store and forward 
and reassembly buffers. 

We have been considering the implementation costs and 
performance benefits of these new algorithms and we expect to 
initiate implementation of portions of the new algorithms in 
the next quarter. 
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